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ABSTRACT 

An evaluation was done of New York City Public 
Schools' Career Awareness Program (Project CAP), which served middle 
school (grades 6 through 9) economically disadvantaged Asian American 
students of limited English proficiency. The program served 222 
students in 2 middle schools, 97.7 percent of whom were eligible for 
the Free Lunch Program. The Project targeted schools with a large 
population of immigrant students from mainland China, Taiweui, and 
Hong Kong. The project provided instruction in English as a Second 
Language, native language arts, and bilingual instruction in content 
area subjects. The students were also offered intensive computer 
classes. In addition, the project aimed to increase students', as 
well as parents', awareness of career opportunities. Evaluation of 
the program was based on demographic data, citywide student test 
scores, and interviews with and surveys of the program director. 
Project CAP'S career education component was particularly valuable in 
helping students become familiar with the U.S. employment system, and 
the Project provided a strong family program. Project CAP was fully 
implemented at one site and partially implemented at the other site 
because of the lack of bilingual staff at that site. The project met 
its objectives in all areas. One appendix summarizes the data 
collection and analysis procedures. (JB) 
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FOREWORD 



The body of this report is precepted by an Extract whfeh {n^nts as overview of salient points of 
the projeo: funding cycle; enrolht^ent %iire$; t^diground of stndents seived; admi^n criteria; and 
programming featiires> strengths, and &nitation$, including the outcome of all objectives. The extract also 
presents the condusoas drawn by the Ofl^ of Re^arch, Evahiatioiif and A^^ment (OREA) about the 
program and its recommendations for prc^ram in^roven^nt. 

The extract » foUo^ the body of the report, titled Pn^ram Aaesgnent . Thfe includes such 
information as staffing, prc^ram inq[>lemenlattoii, and outoc»i» and ifi:)|dea^tatk>n obj^iv^. 
Instructional (4>}ectiv^ are presented fw^ fdk>wed nonin^ructk>n^ objectives. The report then 
addresses those aspects of programming mandated by Title VII regulations that do not have ^d&cally 
stated objecti^^ This may be informatk>n on attendance and dropout rate, grade retention, 
mainstreaming, referrals out of the prc^am to n^t ^>ecial needs of the students, and withdrawals. A 
case hi^oiy conduct the report. 

Data for this profile were collected and analyzed udng a variety of procedures, which are 
described in A ppendix A following the text. 
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EXTRACT 

FUNDING CYCLE: Year 5 of 5 



I.S. 73Q 
I.S. 131M 



24 
2 



Grade Lcveb 

6-9 
6-9 



Enrollment (222 Total) 

105 
117 



STUDENT BACKGROUND 

Native l^ng ua y e Number of Students 

Chinese 218 

Mandarin 60 

Cantonese 131 

Other 27 
Other Languages 4 



Countries of Origin Number of Students 



China 
Hong Kong 
Taiwan 

Other countries 



121 
56 
37 
8 



Mean Years of Education in Native Country : 53; in the United States : 3.1 
Percentage of Students Elfeiblc for Free Lunch Program : 97.7 

ADMISSION CRITERIA 

The project admitted students who scored at or below the 40ih percentile on the I^anguage Assessment 
Datteiy (LAB) and who had been in the United States for less than two years. The project also took teachers' 
and guidance counsetors' recommendations and parents* requests into account when admitting students. 

PROGRAMMING 

Features 

Project CAP targeted two intermediate schools with a large populatbn of immigrant students of limited 
English proficiency (LEP) from mainland China, Taiwan, and Hong Kong. A large percentage of this population 
came from low- income families. The project provided instruction in English as a Second Language (E.S.L.), 
Native I^guage Arts (N.LJL), and tnlii^ua} instruction in content area sufc^eas. The students were also offered 
intensH^ computer dasses. In additbn, the project aimed to increase students*, as weD as parents', awareness of 
career opportunities. 
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Strengths and Limilalions 



The pro^ coordinator rqxmed ihat the career educatbn oompmient was partkniterfy valuable in 
hewing ^udents beoonw famOiar with the Jnited States enq^oyment sfystem. Hie project provkled a strong 
fainify pn^ram, induding parent wortcshops, tnps, and E.S.L clasps. 

One partk^ting sc^l (I.S. 73Q) had no bilingual staff availal^ and offered no N.LA. classes. At this 
same Khool, buflding construction and c^ssroom arrangements frequently disturbed the students. 

CX)NCLUSIONS AND RECOMMENDATIONS 

Project CAP was fully in^iemented at one ate (I.S. 131) and partially implemenied at the other because 
of the lack of bilingual staff at that site. Th^. project met a& its objectives: E.S.L., N.LA. at I.S. 131, content 
area subj^is, attendance, career devcbpment, staff development, cnrrkulum development, and parental 
invoh^ement. 

The conclusions, based on the findiiigs of this evaluation, lead to the following recommendations: 
• Offer Chinese language arts to students at I.S. 73Q. 
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PROGRAM ASSESSMENT 



STAFFING 

Title VII Staff (Tolal 3) 

Title Degree Language Competeiicies 

Proj^ Cooniinator MA. Chinese 

Guklance Counsetor MA. QiineK 

Educ^tiona) Assistant High School Oiinese 



Other Staff Working With Protect Students (Total 8) 



Degree Certification 

M.A 8 E.S.L- 4 

Bil Comnxin Branches 2 

Bit Guidance Counseling 1 

Bfl* Science 2 

Bil. Mathematk^ 1 

Secondaiy 3 

Common Branches 1 



Teaching^mmunicative 
Ptoficiendes flY/CP) ' 

Chinese TP 5 
Spanish CP 3 



IMPLEMENTATION AND OUTCOMES (Objectives prefaced by •) 
English as fk gecond Language (E.S.L.) 

Project students received one pcrk>d of beginning E.S.L* daily. 

All classes used one or more of the following textbooks: 

Enrich Step bv Step with Pfctures 

Getting Atony with Idioms 
Graded ^crdses in English 



Teaching Proficiency (TP): Competent to leach in ibis language. 
Communkrativc Profwcncy (CP): Conversatkjnal capability only. 



• Panid|>aimg siiHtenis wUl make statistkaify signO^raul gains in EngUsh language proficiency. 
Evaluation Instrument: Language Ass^m^nt Batleiy* 

Pretest: March 1990; posltest: March 1991. 

Number of ttiutents for whom pre- and postte^ data were rq>orted: 129 

Mean gain: 538 N.CE.s (s,4= 7.04) 

Mean gain is statitetkaUy sigoifkant (t«8.86, 2<-05). 

Project mtt ati^jectivc. 

Native Language Arts 

Estimated percentage of students bcking native language literacy skilk 10 

Project students at IS. 131M received one period of intemuKliate Chinese N.LA. daify. 

Chinese N.LA. used the resource manual Old Traditions, New Pircdions by the Divbion of Multilingual 
and Multkultural Education of the New York City Publk: Schools, 

• Partkipating students will demonstrate a si^nifkant increase in Chinese language proficiency. 
Evaluation Indicaton Final course grades. 

E%hty*nine percent of the 1 18 students at LS. 131 had final grades at or above 65. 
Project met objective* 

Content Area Subjects 

Pro^ sttntents at LS. 730 took courses in mathematkrs, sdetK^, and social studies, ail of which were 
taught in English using ES.L nietho(k>k^, students at LS. 131M were taught these courses bUingualty. Students 
used the same textbooks as mainstream classes, causing project students some difficulties in social studies. 

• At least 70 percent of the student enrolled in mathematks, sdencc, social studies, and computer Kkills 
win score at or above the pasang criterbn of 6S on the final course grades. 



*OREA used a gap reductk>n design to evaluate the ^ffixl of supplementary instructbn on project students* 
performance on the LAB. Since all LEP students in New York City are entitled to such instruction, no valid 
a)mpari5on group exi^s among these students, and OREA used instead the group on which the LAB was 
normed. Test soor^ are reported in Normal Curve Equivalents {N.CE.sX which are m>rmalized standard stx>res 
with a mean of 50 and a standard cteviation of 21 It is assumed that the norm group has a zero gain in 
NCE.s in the absence of suj^ten^ntaiy instruction and that participating students* gains are attributable to 
project servk«s- 
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Hvaluatioa I&dicalor: Final course grades. 

Pa^y Graites in Contetil Area Subtects 



Total Number Percentage 

Mathematics 222 94.1 

Sdeace 222 95.0 

Social studies 222 86.0 

Project met objective. 

Attendance 

• ParticqiMitmg students* attendance win be s^nifiointly h^ber than that of mainstream students. 

The pmject obtained student attendance informatbn from teachers, contacted parents, and talked to 
students with attendance problems. 

Attendance Rate 

School Project Studcnte* Rate Mainstream Students' Rate Difference 



I.S.73 98.1 91.7 6.4 

I.S. 131 98.1 92.9 5.2* 

*E<.05 

Pmject Boet objective. 
Dropom 

No dropout prevention objective was proposed. 
No project students drc^ped out. 

Career Devetopment 

• The program will organize at least four trips to cuhural centers and business sites to increase 

students' fanuliarity with American culture and with the ^rld of work. The program will organb.c at 
least one conference for t^udents in whH:h representatives of business and industry wQl present 
infonnatk>n on career optbns and skill requirements as indicated by program reoon^ 

The projefS coordinator offered classes m career edtK»tk)n at both ates. The project prepared and 
provided various materials on careers, such as Thirteen Wavs to Get a Job. Thirteen Wavs to Hold Your Job . IJfc 
Skills (Me A Jobs'>. Gettmg Your Foot in the Poor. Job Planner . Consumer Skills . Basic l^cssons in Career 
Education, and F.D.R. Career Handbook. 

Project CAP organized six trips. Five were for students of l.S. 131M (the UN, AT&T» Ellis Island, 
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Linculn Onter, and South Street !kaport) and one for students of hS. 73Q to AT&T headquarters. 

The project organized a tr^ to Garden Cathay, a recreation center in uf^r New York Sutc, for a two-day 
career conferee. Dtirtng the day, students attended seminars at vihkh qpef^ers discussed their educatk>na] and 
professkmal eiq>erfence. In the evening, the indents eof^red varbus eduoitional games and performances. 

Project met ofcjective. 

Staff Devctopment 

• Pnsgram staff wiB partid^te m teadier*training conferences and worlc^K^ as indk:ated by the 
project reconb and teacher interviews. Pn^ram staff wiD enroll in at teast one university course each 
semester as mcikat^ by coltege cour% regbtratbn records. 

Project staff members attended a total of eight conferences or workdiops and all project staff enrolled in 
two univer^ty courses each semester. 

Project met abjective. 
Curriculum Dcwiopment 

• By the end of the pro^t year the rewuro? teachers will have devetoped three resource manuals on 
career awareness (in Chinese) for teadiers and students. 

The resource teacher (tevetoped Jc^Seekinp Handbook for Chinese Bflin£ual Students . Chinese 
Community Servfc^ Agencies Handbook, and Qiinese Convcrsatbn Mcnual . The project completed translaibns 
of bilingual ediK:atk>n material 

Project met objective. 



Parental InvoKement 

• The program will offer workshops to parents of the target populatbn. 

The pro^ offered the workshops "High School Artknibtbn" at both ates, 'TVhal Parents Should Know 
About the Pubhc Schools'* at LS. 730, and 'Substance Abuse and AIDS Prevention" ai l.S. 13 IM. 

The project offered two parent trips (to AT&T headquarters and the Statue of Liberty). On average, 15 
parents panidpated in each event. The project and C.&D. 24 ccMsponsoreda parent conference at which the 
project aK>rdii!ator ^ke on ^^ow to Help Your ChiW to Prepare for the Citywide Reading Test.** This was 
broadcast on the kxra! Chinese i^dk) statbn and reached many additbnal parents. 

The project organised E.S.L, classes for parents, attended by about 15 parents. The classes used various 
njatcrials, such as People Talking, a conversation textbook for adults, and Thirteen Ways to Get Hired . As a 
resuh of partk^ting in the classes, parents gained better understanding of the school and improved their 
Eoglish-i^aking skilk 

Project met objective. 
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STUDENTS WITH SPECIAL ACADEMIC NEEDS 



The project referred two students with learning disabilities to special educaibn. One was transferred to a 
bilingual iq^ecial ediKatioa dass, tHit the other ^udent show^ s^nifkant improvenient and was not transferred 
out. The project referred two talented students to mvmc te^ers in their sdiool. With the help of the project 
staff, a new immigrant student was transferred to an advanced placement da&s. 



MAINSTREAMING 

No students were mainslreamed during the project year. 

Academic .^cfaitvgroent of Former Protect Students in Mainstream 

Project CAP did not provide any data on the academk: achievement of former program partkipants who 
had been mainslreamed. 

CASE HISTORY 

Sherry H. was bom in China and came to the United States in September 1989. She studied hard and 
learned very fast. The project coordinator tutored her in career awarene^ and content areas in Chinese. Shc'rr>' 
was inquisitive and very p>od at exprcsring herself. She was put in an advanced placement class. 



Number of Students Perrentagc 



Referred to ^>ecial edu<atk>n: 2 

Referred to ren^dial jKograms: 0 

Referred to giftedAalented prc^ms: 1 

Retained in gra(fe: 4 



0.1 
0 

0.5 
1.8 
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APPENDIX A 



DATA COLLECTION AND ANALYSIS 

Sludcal Data Form 

Thk one-page form » flited out by staff for eadi partkapatiag and mainsireamed student. OREA gathers 
data from this form on backgrounds, demographics, academic outcomes^ attendance, referrals, and exit from the 
program. 

Project Director's Questionnaire 

The Project Director's Questionnaire includes questbns on staff quaUn€^lk>ns, program inipiementation» 
periocb of instructbn, and instn»nk>ndl material and techniques. 

Proiea Director's Interview 

The interview pthers information on prqpam and ^uifent or staff diaracteriAks not supplied by the 
Project Director's Questionnaire, llie interview al» a!k>«^ proj^ staff to offer qualitati\^ data or amplify 
responses to the Questbnnaire. 

Citywide Test Scores 

OREA retrieves scores centrally from the Language Asse^nent Battery (LAB) and other citywide tests. 
For evaluation purposes, these test scores are reported in Normal Curve Equivalents (N.CE.s). N.C.E^s are 
normahzed standard scores with a n^an of SO and a standard (teviatbn (s.d,} of 2L06. They a>nstiiute an equal- 
interval scale sn whkh the dbunce ts the same bet^i^^en any two adjacent socles. A gain of 5 N.C.Rs is the same 
whether it b at the k>wer or the hi^er end of the K^le. N.QEs <^n be used in arithmetic confutations to 
indicate group progre^. (Percentile soal^ although more faimUar to many, are unsuitable for such compulations 
since they are not equal-inten^al) 

Likert-TVpe Survevs 

Likert-tyf^ surv^cys, m which re^ndents mark their opinions on a scale from one to five, are used in a 
variety of ways. They examine student attitudes (le., toward sdiool and career, native language use, and native 
and mainstream cuhures). They also assess staff and parent attitude and reactions to workshops and other 
activities* 

(?at> Reduction Evaluatbn Design 

OREA uses a gap reductk>n des^n for measuring changes in standardized te^ Since no appropnate 
non-project comparison group is available in New York City, where all students of limited &ig&h proficiency 
(UEP) are entitled to receive suf^lementaiy servfces, OREA compares the progress of participating students with 
that of the group on whkh the t^t was normed. It h assumed that the nonn grmip would show a zero gain in 
the absence of instructkMi, and gains made by project students rould be attributed to project services. 
(Sec Xitywide Test Scores" above.) 

To test whether pre^posttest gains are greater than could be expected by chance atone, OREA uses a 
t^cst. To determine whether a difference between two prqx>rtions (e.g., program and mainstream attendance 
rates) is greater than could he expected by chance, OREA uses a z-tcst. The level of significance ^ set at .05 for 
all tests. 
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